Non-extensivity of the configurational density 
distribution in the classical microcanonical 

ensemble 

Jan Naudts and Maarten Baeten 

Departement Natuurkunde, Universiteit Antwerpen, 
Universiteitsplein 1, 2610 Antwerpen, Belgium 
E-mail Jan.Naudts@ua.ac.be, Maarten.Baeten@student.ua.ac.be 

Abstract 

We show that the configurational probability distribution of a clas- 
sical gas always belongs to the ^-exponential family. Hence, the con- 
figurational subsystem is non-extensive in the sense of Tsallis. One 
of the consequences of this observation is that the thermodynamics 
of the configurational subsystem is uniquely determined up to a scal- 
ing function. As an example we consider a system of non-interacting 
harmonic oscillators. In this example, the scaling function can be de- 
termined from the requirement that in the limit of large systems the 
microcanonical temperature of the configurational subsystem should 
coincide with that of the canonical ensemble. The result suggests that 
Renyi's entropy function is the relevant one rather than that of Tsallis. 

1 Introduction 

Many-particle systems are usually studied in the canonical or grandcanonical 
ensemble. But for small systems the equivalence of ensembles breaks down 
and it becomes interesting to study the microcanonical ensemble. One of the 
intriguing questions in this context is whether phase transitions can occur in 
the way proposed by Dieter Gross in [1]. We will not consider this question 
here but use it as a motivation to study the thermodynamics of closed sys- 
tems. The arguments of Gross are a mixture of statistical physics applied 
on microscopic models and of macroscopic thermodynamics. A more clean 
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approach requires that the thermodynamic formahsm is derived from the sta- 
tistical theory rather than being used as a generally valid but unexplained 
addition. 

The present paper exploits the characteristic of classical systems that the 
coordinates and the conjugated momenta can be considered as two mutually 
interacting subsystems. By considering a subsystem one avoids the difficulty 
that the probability distribution of the microcanonical ensemble is a singular 
measure (a Dirac delta function). By integrating out the momenta, which 
is always possible for a Hamiltonian which is quadratic in the momenta, the 
configurational probability distribution results. To our surprise, this distribu- 
tion function is nonextensive in the sense of Tsallis [2j. Apparently, nobody 
has made this observation in the past twenty years. The implications are 
important. It places nonextensive thermostatistics at the heart of statistical 
physics. In addition, many properties of the configurational subsystem can 
now be studied in a systematic way. 

The present paper makes use of the knowledge that the probability distri- 
butions of nonextensive thermostatistics automatically induce the standard 
thermodynamical formalism. This means in particular that the thermody- 
namic entropy and the temperature of the configurational subsystem are fixed 
in a unique manner up to a monotonic function, which is referred to as the 
scaling function. 

In the next Section we discuss various choices of the microcanonical en- 
tropy function. Section 3 introduces the notion of a g-exponential family of 
probability distributions. In Section 4 the configurational probability dis- 
tribution is calculated. It is shown to belong to the g-exponential family. 
Section 5 deals with thermodynamic relations. Section 6 treats a simple ex- 
ample and discusses the scaling function. Finally, a short discussion follows 
in Section 7. 

2 Microcanonical entropies 

The entropy S{U) which is most often used in the classical microcanonical 
ensemble is 



where uj{U) is the A^-particle density of states. The latter is given by 



S{U) = kB\nuj{U) 




u;{U) 




dp, - dpN [ dqi---dq;v5(f/-i^(q,p)). (2) 
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Here, is the position of the j-th particle and is the conjugated mo- 
mentum, H{ci, p) is the Hamiltonian. The constant h is introduced for di- 
mensional reasons. This definition goes back to Boltzmann's idea of equal 
probability of the microcanonical states and the corresponding well-known 
formula S = ks^TL W, where W is the number of microcanonical states. How- 
ever, this choice of definition of entropy has some drawbacks. For instance, 
for the pendulum the entropy S{U) as a function of internal energy U is a 
piecewise convex function instead of a concave function [3] . The lack of con- 
cavity can be interpreted as a microcanonical instability [H H] . But there is 
no physical reason why the pendulum should be classified as being instable 
at all energies. 

The shortcomings of Boltzmann's entropy have been noticed long ago. A 
slightly different definition of entropy is [HI E] (see also in [7] the reference to 
the work of A. Schliiter ) 

S{U) = kB\nn{U), (3) 
where Q{U) is the integral of uj{U) and is given by 

^iU) = -^f dpi---dp^/ dqi---dq;ve(f/-/7(q,p)). (4) 



Here, 6(x) is Heaviside's function. An immediate advantage of is that the 
resulting expression for the temperature T, defined by the thermodynamical 
formula 

- - - (5) 

coincides with the notion of temperature as used by experimentalists. Indeed, 
one finds 

For a harmonic oscillator the density of states oj{U) is a constant. Hence, © 
implies ksT = U, as wanted. It is well-known that for classical monoatomic 
gases the r.h.s. of (EI) coincides with twice the average kinetic energy per de- 
gree of freedom. This result is also derived below — see ( l28i) . Its significance 
is that the equipartition theorem, assigning ksT /2 to each degree of freedom, 
does hold for the kinetic energy also in the microcanonical ensemble. Quite 
often the average kinetic energy per degree of freedom is experimentally ac- 
cessible and provides a unique way to measure accurately the temperature 
of the system. 
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But also and ([U]) are subject to criticism. In small systems finite 
size corrections appear [3, [S] for a number of reasons. As argued in [H], the 
problem is not the equipartition of the kinetic energy over the various degrees 
of freedom, but the relation between temperature and kinetic energy. 

3 Generalized exponential family 

Recently, the notion of a generalized exponential family has been introduced 
both in the physics P EDI [IH [12] and in the mathematics [T3l [Til [T5t [T6] 
literature. It is shown in the next Section that the configurational probability 
distributions of a classical real gas in the microcanonical ensemble always 
belong to the g-exponential family, which is a special case of the generalized 
exponential family. A first observation in this direction was made in |12j . 

Fix a number q. The probability distribution fg{x) with parameter 6 is 
said to belong to the g-exponential family if it can be written as 

fe{x) = c(x) exp,(-a(^^) - 9H{x)), (7) 

where the g-deformed logarithm [T71 [18] is defined by 

exp^iu) = [I + (l - q)u]f'-'\ (8) 

The notation [«]_). = max{0,M} is used. In (j7]) it is important that H{x) and 
c{x) do not depend on the parameter 6 and that the normalization constant 
a{6) does not depend on x. In the limit q = 1 the g-exponential function 
reduces to the natural exponential function. The notion of the g-exponential 
family then reduces to the standard notion of an exponential family. 

Distributions belonging to the g-exponential family share a number of 
properties which make it attractive to work with these distributions. See 
for instance [T^. These properties are well-known to physicists because the 
Boltzmann-Gibbs distribution 

fp{x) = ^exp{-PH{x)) (9) 

belongs to the standard exponential family, which corresponds with the 
choice g = 1. In particular, when H{x) is the energy of a mechanical system, 
and fd{x) belongs to the g-exponential family, then there is a unique way to 
fit the statistical model into the context of thermodynamics. 
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4 The configurational probability distribut- 
ion 

A classical model of N particles is determined by the Hamiltonian 

H{q, p) = H{qi, qa, • • • qjv, Pi, P2, • • • Pn), (10) 

where is the position of the j-th particle and Pj is the conjugated mo- 
mentum. The microcanonical ensemble is then described by the singular 
probability density function 

fu(ci,p) = ^5(U - H(q,p)), (11) 

where S{-) is Dirac's delta function. The normalization is so that 

I dpi---dpAr / dqi---dqjv/[/(q,p). (12) 

The particles are enclosed in a box with volume V. For simplicity, we take 
only one conserved quantity into account, namely the total energy. Its value 
is fixed to U. 

In the simplest case the Hamiltonian is of the form 



1 ^ 

^(q'p) = ^Ei^^^i'+'^(q)' (13) 



where V(q) is the potential energy due to interaction among the particles 
and between the particles and the walls of the system. It is then possible 
to integrate out the momenta. This leads to the configurational probability 
distribution, which is given by 

/r'(q) = W / dpi---dp^r/c/(q,p). (14) 

J^3N 

The normalization is so that 

1 = / dqi-..dq^/r'(q)- (15) 

Let B{N) denote the volume of a sphere of radius 1 in dimension N. A short 
calculation gives 



£^dp,...dp.e(i/-v(q)-^|:iP,l=) 



with 



h^^ u{U) dU 

c^exp,(-a(^^)-^^V(q)), (16) 



) 

1 1 



e 



1- q[T{3N/2)iu{U)Y"i' 
a{9) = ^N-1-9U, 

For convenience we assume here that uj{U) is a strictly increasing function 
of U so that it can be inverted to obtain U a.s a. function of 9. One concludes 
from (fT6l) that the configurational density function /[/""^^(q) of a classical 
gas in the microcanonical ensemble with parameter U always belongs to the 
g-exponential family with the constant q given by (1171) . 



5 Dual identities 

It is well-known that the g-exponential distribution optimizes the Tsallis en- 
tropy [in] and that together with the configurational energy t/™"^^ it satisfies 
the thermodynamic duality relations f9j. As shown below, these identities 
imply the statement that the ratio VL{U)/uj{U) equals the average kinetic 
energy. 

Of course, also any monotonically increasing function of the Tsallis en- 
tropy will be optimized by the same probability distributions. In particular, 
Renyi's alpha-entropy [20l [2T]. given by 

/a(/) = 7^1nc^ / dqi-.-dq^f^V (18) 
I- a Jk3n \ Cn J 

is such an equivalent entropy function. For that reason we will write the 
configurational entropy 3'^°'^^ as an unknown monotonic function of a quantity 
^conf^ where the later is obtained by maximizing the entropy functional /(/). 
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An appropriate way of writing /(/) is ^2J (assume ks = 1 for conve- 
nience) 



nf) = -CN [ dqi-.-dq^v^f— /(q)) 

Jr3n V Cat / 



with 



Fin) = I Av ln,(v) = [j^ 



-u 



1-q 



(19) 



(20) 



Using ( |T6l fTTI) one obtains 

^conf ^ j^jc 

dqi---dq^/r'(q) 



^conf) 

1 

1 



2 - g V^Af 



/r'(q; 



1-7 



2-q 
1 



(1 + a(0) + ^f/^°"^) 







-f/ 



kin 



l-q 2-q 

with f/'^'" = [/ - ;7™°^ 

The corresponding Massieu function is then given by 

^conf /irrconf 



(21) 



$(^) = 5™°' - eu' 
1 



l-q 2-q 2-q 
Using the dual identities [U [12] 

d<l r dS*™""^ 

= -t/^'^f and — -- = 9 

AO df/™°f 



one obtains 



and 



conf = t/ + (1 _ g)0^1i^ + 9^ 



{i-q)e 



u 



kin 



+ 9 



d9 



dU 

(^f/conf • 



(22) 



(23) 



(24) 



(25) 



Since both identities imply the same result we continue with one of them. 
The latter can be written as 



df/-^ ^'(t/),,kin 



dU uj{U) 



1 



(26) 



Use this result to calculate 



dU 



u{U)U 



kin 



2-g 



3iV 



1 - 



dU 



conf 



df/ 



uj{U). 



By integrating this expression one obtains the average kinetic energy 

^NVliU) 



U 



kin 



2 uo{Uy 



(27) 



(2^ 



This expression gives the relation between the average kinetic energy and 
the total energy U via the density of states uj{U) and its integral Vl{U). 
The integration constant must be taken so that VL{U) = when U = Umm 
(implying that the kinetic energy vanishes in the ground state). 



6 Example 



Consider a set of 3A^ harmonic oscillators. The potential energy equals 

^ 3N 

V(q) = -mJ2^hl 



One calculates 



1 



xQ 



dpi--- dp, 



'3N 



dgi ■ ■ ■ dg: 



3N 



(U p] m 
j j 



2 2 



1 /AtiUY 
(3iV)!nff^ V W 



From ffTTl) and (l30l) now follows 



1 

e 



r(3A^/2) 



Using Stirling's approximation one obtains 



r(3A^/2) ^ ^^^^^ 



3JV-1 



1-g 



T{3N) 



6NJ 



(29) 



(30) 



(31) 



(32) 



so that, assuming that all Uj are equal to some u, 

(33) 



1 /An U 



9 \huj3N 

On the other hand, the inverse temperature f3 of the canonical ensemble with 
3N degrees of freedom satisfies 

The requirement that the canonical temperature coincides with the micro- 
canonical temperature as obtained from ([5]) now determines the monotonic 
function which relates the thermodynamic 5"™°^ to the quantity 3'^°'^^ . From 
this requirement follows that 

= Arinf/^°"^^ + A (35) 
for some constant A. On the other hand, (133!) implies that 

IfhujYiSNf 



^cont ^ constant. (36) 

Therefore the relation between 5*™°^ and 5''^°'^^ is logarithmic. More precisely, 
^conf ^ ^(^conf)^ ^j^j^ ^(^^) ^j^g f^^j^ ^(^^) ^ -3A^ ln(5 - x) + C, with 

constants -B and C. This suggests that Renyi's entropy functional is the 
right one to start with. Indeed, let a = 2 — g. The relation between Renyi's 
IM) and /(/), as given by is Uf) = aHf)) with 

^x) = In [(2 - g) (1 - (1 - q)x)] . (37) 



Take the constant in (136!) equal to 1/(1 — g). Then one obtains 



jyconf 

In — — - + constant 
6A' 



(3^ 



This yields 



which is an acceptable relation for the inverse temperature (3. 



(39) 
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7 Discussion 



The main purpose of the present paper is to point out that the configurational 
probabihty distribution of a classical gas always belongs to the g-exponential 
family. The non-extensivity parameter q is given by 

1 3 

(40) 



l-q 2 

where is the number of particles. The latter expression has appeared quite 
often in the literature, see for instance [22l EHl |24j| . The main consequence of 
our observation is that the subsystem of configurational degrees of freedom 
can be described using standard thermodynamics involving the entropy 5"™"^^ 
of the configurational subsystem. The thermodynamic relation 

J Cconf 

= dfT^ (41) 

then defines the micro canonical inverse temperature /3. The same thermody- 
namic relation can be used to rederive a known result, which states that the 
average kinetic energy f/"^™ of a classical gas in the microcanonical ensemble 
can be obtained from the density of states oj{U) and its integral VL{U) — see 

(EHD. 

Note that the probability distributions determine the entropy functional 
only up to a monotonically increasing function S,{x). Therefore we used the 
notations S instead of S and 9 instead of (3 for the entropy, respectively the 
inverse temperature, because the function ^ which relates S to the thermo- 
dynamic S is not known a priori. However, in the limit of a large system 
{N — i> oo) the nonextensivity parameter goes to 1 and the configurational 
probability distribution approximates a Boltzmann-Gibbs distribution. It 
is then obvious that ^{x) should be chosen in such a way that the inverse 
temperature 9 becomes the inverse temperature (3 of the canonical ensemble. 

For the example of 3iV non-interacting harmonic oscillators we calculate 
all quantities explicitly and obtain an explicit expression for the scaling func- 
tion E,{x). It turns out that the relevant entropy function, which equals the 
thermodynamic entropy when evaluated in equilibrium, is not that of Tsal- 
lis but rather that of Renyi. From the point of view of Jaynes' maximum 
entropy principle both are of course equivalent. But in the context of ther- 
modynamics only one of the two can yield correct values for the temperature. 

In conclusion, we did not solve the problem of fixing the right expression 
for the microcanonical entropy S. But a good candidate for the configura- 
tional contribution 5*™"^^ is the value of Renyi's entropy function evaluated 
at the equilibrium value of the configurational probability distribution. 
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